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Program description^ 


■ ■ ^ 

stepping Stones to Literacy (SSL) is a supplemental curriculum 
designed to promote listening, print conventions, phonological 
awareness, phonemic awareness, and serial processing/rapid 
naming (quickly naming familiar visual symbols and stimuli such 
as letters or colors). The program targets kindergarten and older 


preschool students considered to be underachieving readers, 
based on teacher’s recommendations, assessments, and sys- 
tematic screening. Students participate in 10- to 20-minute daily 
lessons in a small group or individually. The curriculum consists 
of 25 lessons, for a total of 9-15 hours of instructional time. 



Research 



Two studies of Stepping Stones to Literacy met the What Works 
Clearinghouse (WWC) evidence standards. The two studies 
included 120 kindergarten students in 17 elementary schools 
in the Midwest.2 The WWC considers the extent of evidence 



for Stepping Stones to Literacy to be small for alphabetics. No 
studies that met WWC evidence standards with or without res- 
ervations addressed fluency, comprehension, or general reading 
achievement. 



Effectiveness stepping Stones to Literacy was found to have positive effects on student outcomes in the alphabetics domain. 







General reading 


Alphabetics 


Fluency 


Comprehension achievement 



Rating of effectiveness 


Positive 


na 


na 


na 


Improvement index^ 


Average: +30 percentile points 


na 


na 


na 



Range: +14 to +40 percentile points 



na = not applicable 



1. The descriptive information for this program was obtained from pubiiciy avaiiabie sources: the program’s website (www.steppingstonestoiiteracy.com; 
downioaded March, 2007) and the research iiterature (Neison, Benner, & Gonzaiez, 2003; Neison, Stage, Epstein, & Pierce, 2005). The WWC requests 
deveiopers to review the program description sections for accuracy from their perspective. Further verification of the accuracy of the descriptive informa- 
tion for this program is beyond the scope of this review. 

2. The evidence presented in this report is based on avaiiabie research. Findings and conciusions may change as new research becomes avaiiabie. 

3. These numbers show the average and range of improvement indices for aii findings across the study. 
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Additional program 
information^ 



Research 



WWC Intervention Report 



Developer and contact 

Developed by J. Ron Nelson, Penny Cooper, and Jorge Gonza- 
lez, Stepping Stones to Literacy Is distributed by Sopris West. 
Address: 4093 Specialty Place, Longmont, CO 80504. Email: 
customerservice@soprlswest.com. Web: www.sopriswest.com . 
Telephone: (800) 547-6747. 

Scope of use 

No information on the scope of use or the demographic charac- 
teristics of program users is available. 

Teaching 

Stepping Stones to Literacy (SSL) comprises twenty-five, 10- to 
20-minute lessons that supplement the regular reading cur- 
riculum. In each lesson, the teacher guides students through four 
to six sequenced activities to help students master five critical 
early literacy skill sets: listening, print conventions, phonological 
awareness, phonemic awareness, and serial processing/rapid 
naming. Students without deficits or with mild to moderate early 



literacy deficits are usually taught in small groups; students 
with significant early literacy deficits are taught individually. The 
curriculum includes a lesson book, with a separate section on 
serial rapid automatic naming activities (where children practice 
making quick visual-verbal associations of known sets of colors, 
numbers, and/or letter names in a left-to-right format), and 
instructional prompts in English and Spanish. 

Each of the 25 lessons begins with a set of nursery rhymes 
and follows with a set of sequenced instructional activities. 
Teachers use the model-lead-test instructional format. The 
teacher first models the target skill. Students replicate the 
example and practice the skill with assistance from the teacher. 
Teachers monitor student progress and re-teach the skill to stu- 
dents who do not fully master it. Lessons can also be repeated 
to help students fully master the early literacy skills taught. 

Cost 

The SSL kit is available from Sopris West for $223.49, which 
includes the lesson book and the instructor’s guide. 



Two studies reviewed by the WWC investigated the effects of 
Stepping Stones to Literacy. Both studies (Nelson, Cooper, & 
Gonzalez, 2005; Nelson, Stage, Epstein, & Pierce, 2005) were 
randomized controlled trials that met WWC evidence standards. 

The Nelson, Cooper, & Gonzalez (2005) study included 36 
kindergarten students from seven schools in a Midwestern city. 
Students were randomized to intervention and comparison 
groups. The intervention group received SSL in addition to the 
regular curriculum used in the schools. Open Court Reading. 
The comparison group received the regular curriculum with no 
additional supplement. 

The Nelson, Stage, Epstein, & Pierce (2005) study included 
84 kindergarten students from ten schools in the Midwest. 



Students were randomized to intervention and comparison 
groups. The intervention group received SSL in addition to 
the regular curriculum used by the schools. The comparison 
group received the regular curriculum with no additional 
supplement. 

Extent of evidence 

The WWC categorizes the extent of evidence in each domain as 
small or moderate to large (see the What Works Clearinghouse 
Extent of Evidence Categorization Schemed . The extent of 
evidence takes into account the number of studies and the 
total sample size across the studies that met WWC evidence 
standards with or without reservations.® 



4. The descriptive information for this program was obtained from pubiiciy avaiiabie sources: the program’s website (www.steppingstonestoiiteracy.com; 
downioaded March, 2007) and the research iiterature (Neison, Benner, & Gonzaiez, 2003; Neison, Stage, Epstein, & Pierce, 2005). The WWC requests 
deveiopers to review the program description sections for accuracy from their perspective. Further verification of the accuracy of the descriptive informa- 
tion for this program is beyond the scope of this review. 

5. The Extent of Evidence Categorization was deveioped to teii readers how much evidence was used to determine the intervention rating, focusing on the 
number and size of studies. Additional factors associated with a related concept, external validity, such as the students’ demographics and the types of 
settings in which studies took piace, are not taken into account for the categorization. 
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RSSGarch (continued) The WWC considers the extent of evidence for Stepping addressed fluency, comprehension, or general reading 

Stones to Literacy to be small for alphabetics. No studies that achievement, 
met WWC evidence standards with or without reservations 



Effectiveness 



Findings 

The WWC review of interventions for beginning reading 
addresses student outcomes in four domains: alphabetics, 
fluency, comprehension, and general reading achievement. Both 
studies reviewed for this WWC intervention report addressed 
outcomes for constructs in the alphabetics domain.® 

Aiphabetics: The Nelson, Benner, & Gonzalez (2005) study 
findings for alphabetics are based on the performance of SSL 
students and comparison students on: 

• Three measures of phonological awareness (Comprehensive 
Test of Phonological Processing (CTOPP): Phonological 
Awareness subtest and Dynamic Indicators of Basic Early 
Literacy Skills (DIBELS): Phoneme Segmentation Fluency and 
Initial Sound Fluency subtests). 

• One measure of letter knowledge (DIBELS: Letter Naming 
Fluency subtest). 

• One measure of phonics (DIBELS: Nonsense Words Fluency 
subtest). 

The authors found and the WWC confirmed statistically 
significant positive effects of SSL on all outcomes. 



The Nelson, Stage, Epstein, & Pierce (2005) study findings for 
alphabetics are based on the performance of SSL and compari- 
son students on: 

• One measure of phonological awareness (CTOPP: Phonologi- 
cal Awareness subtest). 

• One measure of letter knowledge (DIBELS: Letter Naming 
Fluency subtest). 

• Two measures of phonics (Woodcock Reading Mastery Test- 
Revised: Word Identification and Word Attack subtests). 

The authors found and the WWC confirmed statistically 

significant positive effects of SSL on all outcomes 

Rating of effectiveness 

The WWC rates the effects of an intervention in a given outcome 
domain as positive, potentially positive, mixed, no discernible 
effects, potentially negative, or negative. The rating of effective- 
ness takes into account four factors: the quality of the research 
design, the statistical significance of the findings,^ the size of 
the difference between participants in the intervention and the 
comparison conditions, and the consistency in findings across 
studies (see the WWC Intervention Rating SchemeL 



The WWC found Stepping 
Stones to literacy \o 
have positive effects 
for aiphabetics 



Improvement index 

The WWC computes an improvement index for each individual 
finding. In addition, within each outcome domain, the WWC 
computes an average improvement index for each study and 
an average improvement index across studies (see Technical 
Details of WWC-Conducted Computations) . The improvement 



index represents the difference between the percentile rank 
of the average student In the Intervention condition versus 
the percentile rank of the average student In the comparison 
condition. Unlike the rating of effectiveness, the improvement 
index is based entirely on the size of the effect, regardless of 
the statistical significance of the effect, the study design, or the 



6. For definitions of the domains and constructs, see the : :. 

7. The ievei of statistical significance was reported by the study authors or, where necessary, caicuiated by the WWC to correct for ciustering within ciass- 
rooms or schools and for multiple comparisons. For an explanation, see the WWC Tutoriai on Mismatch . See the Technicai Detaiis of WWC-Conducted 
Computations for the formuias the WWC used to caicuiate the statisticai significance, in the case of SSL no corrections for ciustering or multipie 
comparisons were needed. 
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The WWC found Stepping 
Stones to Utency to 
have positive effects for 
aiphabetics (continued) 


analyses. The improvement index can take on values between 
-50 and +50, with positive numbers denoting resuits favorabie to 
the intervention group. 

The average improvement index for aiphabetics is +30 per- 
centile points across the two studies, with a range of +14 to +40 
percentile points across findings. 


Summary 

The WWC reviewed two studies on SSL. Both studies met the 
WWC evidence standards. Based on these two studies, the 
WWC found positive effects in the aiphabetics domain. The 
evidence presented in this report may change as new research 
emerges. 


References 


Met WWC evidence standards 

Nelson, J. R., Benner, G. J., & Gonzalez, J. (2005). An investiga- 
tion of the effects of a prereading intervention on the early 
literacy skills of children at risk of emotional disturbance 
and reading problems. Journal of Emotional and Behavioral 
Disorders, 73(1), 3-12. 


Additional source: 

Nelson, J. R., Cooper, R, & Gonzales, J. (2003). Stepping 
Stones to Literacy: What Works Clearinghouse submission. 
(Available from the Center for At-Risk Children’s Services, 
202 Barkley Center, Lincoln, NE 68583-0732) 

Nelson, J. R., Stage, S. A., Epstein, M. H., & Pierce, C. D. (2005). 
Effects of a prereading intervention on the literacy and social 
skills of children. Exceptional Children, 72(1), 29-45. 



For more information about specific studies and WWC caicuiations, piease see the WWC Stepping Stones to 
Literacy Technicai Appendices . 



WWC Intervention Report Stepping Stones to Literacy 



June 25, 2007 



Appendix 



Appendix A1.1 


Study characteristics: Neison, Cooper, & Gonzaies, 2005 (randomized controiied triai) 


Characteristic 


Description 


Study citation 


Nelson, J. R., Benner, G. J, & Gonzalez, J. (2005). An investigation of the effects of a prereading intervenfion on the early literacy skills of children at risk of emotional distur- 
bance and reading problems. Journal of Emotional and Behavioral Disorders, 13(^), 3-12. 


Participants 


Forty-two kindergarten students with behavior problems were randomly assigned to either the intervention {Stepping Stones to Literacy) or the comparison condition. Three 
students who were performing at or above average with respect to phonological awareness skills were removed from each condition. Therefore, the analysis included 36 
students (18 students per condition). Most of the participants were male students (17 males and one female in each condition). Minority students were 44% of the intervention 
group and 34% of the comparison group. The percentages of students eligible for free/reduced price lunch were 72% and 44% in the intervention and comparison groups, 
respectively. One student in each condition was an English language learner. 


Setting 


The study took place in seven elementary schools in a medium-sized Midwestern city. 


Intervention 


Over a five-week period, intervention group students received Stepping Stones to Literacy as a supplement to the core curriculum (Open Court Reading and early literacy 
developmental activities designed by the classroom teachers). The Stepping Stones to Literacy program consisted of fwenty-five 20-minute one-on-one daily tutoring lessons. 
According to reports by tutors and independent observers, the tutoring sessions were implemented with a high level of fidelity to the Stepping Stones to T/teracy curriculum. 


Comparison 


Comparison group students received the core curriculum and no other supplemental instruction. The study indicated that no attempt was made to change any of the teachers’ 
regular instructional practices in the classroom. 


Primary outcomes 
and measurement 


The primary outcome measures were the Comprehensive Test of Phonological Processing (CTOPP): Phonological Awareness subtest and the Dynamic Indicators of Basic Early 
Literacy Skills (DIBELS): Initial Sound Fluency, Phoneme Segmentation Fluency, Letter Naming Fluency, and Nonsense Words Fluency subtests (see Appendix A2 for more 
detailed descriptions of outcome measures). 


Teacher training 


Information on training of tutors was not reported in the study. 
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Appendix A1.2 Study characteristics: Neison, Cooper, & Gonzaies, 2005 (randomized controiied triai) 



Characteristic Description 



Study citation 


Nelson, J. R., Stage, S. A., Epstein, M. H., & Pierce, C. D. (2005). Effects of a prereading intervention on the literacy and sociai skiiis of children. Exceptional Children, 
72(1), 29-45. 


Participants 


Participants were 84 kindergarten students (64 in the intervention group and 20 in the comparison group) from 27 classrooms. Students were randomly assigned to 
conditions.^ All students had behavior problems, which were identified based on high scores on a measure developed by Walker, Severson, & Gates (1995; as cited in Nelson, 
Stage, Epstein, & Pierce, 2005) to indicate risk for behavioral disorders. The second criterion for participating in the study was a low score on the DIBELS Letter Naming Flu- 
ency subtest. The analysis sample included 47 students in the intervention group and 16 students in the comparison group.^ For the analysis sample, the study reported that 
75% of the participants were male students, and about 26% were ethnic minority students. In addition, about 44% of the sample qualified for the free/reduced lunch program. 


Setting 


The participating students attended 10 elementary schools in the Midwest. 


Intervention 


The intervention was implemented during tutoring sessions, which were a supplement to the regular curriculum used at the schools. According to reports by tutors and 
independent observers, the tutoring sessions were implemented with a high level of fidelity. 


Comparison 


No information was provided for the comparison group other than that this group did not receive SSL services. The study indicated that no attempt was made to change any of 
the teachers’ regular instructional practices in the classroom. 


Primary outcomes 
and measurement 


Primary outcome measures included the Comprehensive Test of Phonological Processing (CTOPP): Phonological Awareness subtest, the Dynamic Indicators of Basic Early 
Literacy Skills: Letter Naming Fluency subtest, and the Woodcock Reading Mastery Test-Revised: Word Identification and Word Attack subtests (see Appendix A2 for more 
detailed descriptions of outcome measures). 


Teacher training 


Information on training of tutors was not reported in the study. 



1 . The WWC has requested and received from the study author additional information about the assignment process. According to the first study author, 20 students’ identification numbers were 
randomly selected from the eligible sample and assigned to the comparison group. The remaining students were assigned to the intervention group. 

2. In keeping with the Beginning Reading Protocol , the WWC examined pretest/baseline scores and standard deviations of the post-attrition sample. The groups were similar at baseline (based on 
the WWC beginning reading review’s convention of a mean difference less than 0.50 SD) and the study was not downgraded due to attrition. 
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Appendix A2 Outcome measures in the aiphabetics domain by construct 



Characteristic 


Description 


Phonological awareness 

Comprehensive Test of 
Phonological Processing 
(CTOPP); Phonological 
Awareness 


A norm-referenced assessment that provides an overall measure ot a child’s phonological awareness skills. The composite score, which is based on three subtests, was used 
for rating purposes. The Elision subtest includes 20 items that measure the extent to which a child can say a word and then say what is left after dropping out designated 
sounds. The Blending Words subtest includes 20 items that measure a child’s skill in blending separately presented sounds together to form words. The Sound Matching 
subtest includes 20 items that measure a child’s skill in matching sounds (as cited in Nelson, Benner, & Gonzalez, 2005 and Nelson, Stage, Epstein, & Pierce, 2005). 


Dynamic Indicators of Basic 
Early Literacy Skills (DIBELS); 
Phoneme Segmentation 
Fluency subtest 


This standardized test measures a child’s ability to segment three- and four-phoneme words into their individual phonemes fluently. The child is presented with words orally 
and asked to produce verbally the individual phonemes for each word (as cited in Nelson, Benner, & Gonzalez, 2005). 


DIBELS: Initial Sound 
Fluency subtest 

Letter knowledge 


This standardized test measures a child’s ability to identify the initial sound in an orally presented word. The child is presented with four pictures and associated names and 
asked to identify (by pointing to or naming) the picture that starts with the same sound presented orally by the examiner (as cited in Nelson, Benner, & Gonzalez, 2005). 


DIBELS: Letter Naming 
Fluency subtest 

Phonics 


This is a subtest ot a standardized measure in which students are presented with a page of upper- and lower-case letters arranged in a random order and are asked to name 
as many letters as they can. The score is the number of letters named correctly in one minute (as cited in Nelson, Benner, & Gonzalez, 2005 and in Nelson, Stage, Epstein, & 
Pierce, 2005). 


DIBELS: Nonsense Words 
Fluency subtest 


This subtest measures a child’s word reading ability, including letter-sound correspondence and the ability to blend letter sounds into words (as cited in Nelson, Benner, & 
Gonzalez, 2005). 


Woodcock Reading Mastery 
Test-Revised (WRMT-R): 
Word Identification subtest 


This is a subtest ot the norm-referenced WRMT-R. It includes 51 items that test decoding skills. It requires the child to read aloud isolated real words that range in frequency 
and difficulty (as cited in Nelson, Stage, Epstein, & Pierce, 2005). 


WRMT-R: Word 
Attack subtest 


This is a subtest ot the norm-referenced WRMT-R. It includes 106 items that measure the child’s ability to decode nonsense words. Students are aware that the words are 
not real (as cited in Nelson, Stage, Epstein, & Pierce, 2005). 



WWC Intervention Report Stepping Stones to Literacy 



June 25, 2007 




Appendix A3 Summary of study findings inciuded in the rating for the aiphahetics domain hy construct^ 



Authors’ findings from the study 



Mean outcome 

(standard deviation^) WWC calculations 







Sample size 






Mean difference^ 




Statistical 






Study 


(schools/ 


SSL 


Comparison 


{SSL- 




significance^ 


Improvement 


Outcome measure 


sample 


students) 


group 


group 


comparison) 


Effect size^ 


(at a = 0.05) 


index^ 



Construct: Phonological awareness 




















Nelson, Benner, & Gonzalez, 2005 (randomized controlled trial)^ 








CTOPP: Phonological Awareness 


Kindergarten 


7/36 


98.24 


90.90 


7.34 


0.76 


Statistically 


- h 28 




(low-achievers with 
behavior problems) 




( 9 . 40 ) 


( 9 . 60 ) 






significant 




DIBELS: Phoneme 


Kindergarten 


7/36 


19.43 


11.20 


8.23 


0.68 


Statistically 


+25 


Segmentation Fluency 


(low-achievers with 
behavior problems) 




( 8 . 10 ) 


( 14 . 60 ) 






significant 




DIBELS: Initial Sound Eluency 


Kindergarten 


7/36 


21.31 


11.30 


10.01 


1.26 


Statistically 


+40 




(low-achievers with 
behavior problems) 




( 7 . 90 ) 


( 7 . 60 ) 






significant 








Nelson, Stage, Epstein, & Pierce, 2005 (randomized controlled trial)^ 








CTOPP: Phonological Awareness 


Kindergarten 


10/63 


96.10 


90.40 


5.70 


0.50 


Statistically 


-Hi 9 




(low-achievers with 
behavior problems) 




( 11 . 50 ) 


( 10 . 50 ) 






significant 




Construct: Letter knowledge 






















Nelson, Benner, & Gonzalez, 2005 (randomized controlled trial)^ 








DIBELS: Letter Naming Eluency 


Kindergarten 


7/36 


25.18 


19.90 


5.28 


0.37 


Statistically 


-Hi 4 




(low-achievers with 
behavior problems) 




( 10 . 60 ) 


( 16 . 90 ) 






significant 








Nelson, Stage, Epstein, & Pierce, 2005 (randomized controlled trial)^ 








DIBELS: Letter Naming Eluency 


Kindergarten 


10/63 


37.70 


22.00 


15.70 


1.08 


Statistically 


- h 36 




(low-achievers with 
behavior problems) 




( 14 . 70 ) 


( 13 . 40 ) 






significant 





(continued) 
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Appendix A3 Summary of study findings inciuded in the rating for the aiphahetics domain hy construct (continued) 









Authors’ findings from the study 














Mean outcome 
(standard deviation^) 




WWC calculations 




Outcome measure 


Study 

sample 


Sample size 
(schools/ 
students) 


SSL Comparison 

group group 


Mean difference^ 
{SSL- 
comparison) 


Statistical 
significance^ 
Effect size^ (at a = 0.05) 


Improvement 

index^ 



Construct: Phonics 



Nelson, Benner, & Gonzalez, 2005 (randomized controlled trialf 



DIBELS: Nonsense 


Kindergarten 


7/36 


12.34 


3.90 


8.44 


0.94 


Statistically 


+33 


Words Fluency 


(iow-achievers with 
behavior problems) 




(10.00) 


(7.30) 






significant 








Nelson, Stage, Epstein, & Pierce, 2005 (randomized controlled trial)^ 








WRMT-R: Word Identification 


Kindergarten 


10/63 


104.80 


94.30 


10.50 


1.03 


Statistically 


+35 




(iow-achievers with 
behavior problems) 




(10.50) 


(8.40) 






significant 




WRMT-R: Word Attack 


Kindergarten 


10/63 


105.30 


96.2 


9.10 


0.86 


Statistically 


+31 




(iow-achievers with 
behavior problems) 




(10.60) 


(9.80) 






significant 





Average^ for aiphahetics (Nelson, Benner, & Gonzales, 2005) 


0.80 


Statistically 

significant 


+29 


Average^ for aiphahetics (Nelson, Stage, Epstein, & Gonzales, 2005) 


0.87 


Statistically 

significant 


+31 


Domain average^ for aiphahetics across all studies 


0.84 


na 


+30 


na = not applicable 



1 . This appendix reports findings considered for the effectiveness rating and the average improvement indices. 

2. The standard deviation across aii students in each group shows how dispersed the participants’ outcomes are: a smaiier standard deviation on a given measure wouid indicate that participants had more simiiar outcomes. 

3. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. The SSL group mean eguais the comparison group mean pius the mean difference between the 
groups. The computation of the mean difference took into account the pretest difference between the study groups 

4. For an expianation of the effect size caicuiation, see Technicai Detaiis of WWC-Conducted Computations . 

5. Statisticai significance is the probabiiity that the difference between groups is a resuit of chance rather than a reai difference between the groups. 

6. The improvement index represents the difference between the percentiie rank of the average student in the intervention condition versus the percentiie rank of the average student in the comparison condition. The improvement index 
can take on vaiues between -50 and +50, with positive numbers denoting resuits favorabie to the intervention group. 

7. The ievei of statisticai significance was reported by the study authors or, where necessary, caicuiated by the WWC to correct for ciustering within ciassrooms or schoois and for muitipie comparisons. For an expianation about the cius- 
tering correction, see the WWC Tutoriai on Mismatch . See Technicai Detaiis of WWC-Conducted Computations for the formuias the WWC used to caicuiate statisticai significance, in the case of Neison, Benner, & Gonzaiez (2005) and 
Neison, Stage, Epstein, & Pierce (2005), no corrections for ciustering were needed, in addition, no corrections for muitipie comparisons were needed as the study reported on ievei of statisticai significance after Bonferonni corrections. 

8. The WWC-computed average effect sizes for each study and for the domain across studies are simpie averages rounded to two decimai piaces. The average improvement indices are caicuiated from the average effect sizes. 
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Appendix A4 Stepping Stones to Literacy rating for the aiphabetics domain 



The WWC rates an intervention’s effects in a given outcome domain as positive, potentiaily positive, mixed, no discernibie effects, potentialiy negative, or negative.'' 

For the outcome domain of aiphabetics, the WWC rated Stepping Stones to Literacy as having positive effects. The other ratings (potentiaiiy positive effects, mixed 
effects, potentiaily negative effects, and negative effects) were not considered because Stepping Stones to Literacy was assigned the highest appiicabie rating. 



Rating received 

Positive effects: Strong evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: Two or more studies showing statisticaiiy significant positive effects, at least one of which met WWC evidence standards for a strong design. 

Met. Two studies of Stepping Stones to Literacy showed statistically significant positive effects. Both studies met the WWC evidence standards 
for a strong design. 

and 

■ Criterion 2: No studies showing statisticaiiy significant or substantively important negative effects. 

Met. No studies showed indeterminate or negative effects. 



1 . For rating purposes, the WWC considers the statistical significance of individual outcomes and the domain-level effect. The WWC also considers the size of the domain-level effect for ratings of 
potentially positive or potentially negative effects. See the WWC Intervention Rating Scheme for a complete description. 
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Appendix A5 Extent of evidence by domain 



Outcome domain 


Number of studies 


Schoois 


Sampie size 


Students 


Extent of evidence^ 


Alphabetics 


2 


17 




120 


Small 


Fluency 


0 


0 




0 


na 


Comprehension 


0 


0 




0 


na 


General reading achievement 


0 


0 




0 


na 



na = not applicable/not studied 

1 . A rating of “moderate to large” requires at least two studies and two schools across studies in one domain and a total sample size across studies of at least 350 students or 14 classrooms. 
Otherwise, the rating is “small.” 
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